Object recognition by a laser scanner using multimodal information
نویسندگان
چکیده
This paper presents a new object recognition technique using multimodal information by a laser scanner. A ToF laser scanner captures a three dimensional (3D) shape of a target object precisely by measuring the round-trip time of a laser pulse. In addition, a laser scanner also collects the strength of the reflected laser (reflectivity) as side-product of range measurement. Focusing on the fact that the reflectivity contains rich appearance information of the target object, the proposed technique utilizes not only range but also reflectance information to improve the recognition performance. To evaluate the validity of the proposed technique, we applied it for the classification of moving objects on a road as a traffic census application.
منابع مشابه
Detection of some Tree Species from Terrestrial Laser Scanner Point Cloud Data Using Support-vector Machine and Nearest Neighborhood Algorithms
acquisition field reference data using conventional methods due to limited and time-consuming data from a single tree in recent years, to generate reference data for forest studies using terrestrial laser scanner data, aerial laser scanner data, radar and Optics has become commonplace, and complete, accurate 3D data from a single tree or reference trees can be recorded. The detection and identi...
متن کاملBayesian networks for error handling through multimodality fusion in spoken dialogues with mobile robots
In this paper, we introduce Bayesian networks architecture for combining speech-based information with that from another modality for error handling in human-robot dialogue system. In particular, we report on experiments interpreting speech and laser scanner signals in the dialogue management system of the autonomous tour-guide robot RoboX, successfully deployed at the Swiss National Exhibition...
متن کاملMultimodal Human-Robot Interaction in an Assistive Technology Context
In this paper, we present a prototype robotic system that captures, processes and fuses speech, vision and laser-depth data to more accurately interpret and perform simple tasks in a domestic environment. We can never assume that any one of these inputs are completely accurate, but by using a combination, a more accurate interpretation could be found. For each speech, gesture recognition and ob...
متن کاملImage Augmented Laser Scan Matching for Indoor Localization
Indoor localization is a challenging problem addressed extensively by both robotics and computer vision communities. Most existing approaches focus on using either cameras or laser scanners as the primary sensor for pose estimation.In laser scan matching based localization, finding scan point correspondences across scans is a challenging problem as individual scan points lack unique attributes....
متن کاملBuilding Photorealistic Models Using Data Fusion
We are currently working on several projects related to the automatic fusion and high-level interpretation of 2D and 3D sensor data for building models of real-world objects and scenes. One of our major goals is to create rich and geometrically correct, scalable photorealistic 3D models based on multimodal data obtained by different sensors, such as camera and laser scanner. In this paper, we p...
متن کامل